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EFFECTS OF MODELING AND FEEDBACK TREATMENTS ON 
THE DEVELOPMENT OF TEACHERS' QUESTIONING SKILLS 



'•v?' 



Karen E. Claus^ 



The Questioning Skill 



This study was conducted as part of the Technical Skills of Teaching 
Project of the Stanford Center for Research and Development in Teaching. 
The purpose of the research was (a) to ‘define a central teaching skill 
which stimulates pupil inquiring behavior within the context of student- 
teacher dialogue and (b) to train beginning teachers to use this skill. 
Questioning was selected as the teaching skill. 



Empirical evidence has shown that teachers tend to use mainly fact- 
ually oriented question/*in their classroom discourse. Creative problem 
solving, however, implies complex questioning skills. On the assumption 
that complex or higher order problem solving skills are learned and can 
be sharpened through practice, the first step to higher order problem 
solution is the asking of a higher-order,, question. Since teachers have 
shown that they do not utilize this type' of question, an important 
teacher training goal should be to train them in its use. The present 
study utilized an empirical approach in which training methods previously 
demonstrated to be effective were manipulated experimentally in order to 
determine the most efficient training combinations. 

f 

* 

The Type of Questions Teachers Ask 



Investigations by Flanders and Amidon (1961) and Bellack, Kliebard, 
Hyman and Smith (1966) have shown that over half of formal classroom 
communication consists of some form of teacher question fol owe y a 
student response. The overwhelming majority of these questions are e- 
signed to elicit recognition or recall of factual information. J)o dl (1965) 
identified and studied five types of classroom quest ion- answer patterns 
and found that information-seeking questions were by far the most typical. 
In earlier studies, analysis of tapescripts of the classroom discussion of 
gifted children revealed /tiiat routine and cognitive-memory questions were 
more common than questions which elicited convergent, evaluative, or di- 
vergent thinking (Aschner, 1963; Aschner, Gallagher, Perry, sar, e 
& Farr, 1965; Gallagher & Aschner, 1963; Gallagher, 1965 a & b) . Gus 
(1966) analyzed questions asked in second-, fourth-, and sixth-grade rea - 
ing circles ^d found that the factual aspects of reading comprehension 
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were emphasized most. These findings are not new. Almost sixty years 
ago Rommiett Stevens used '1st enographic reports of classroom discussions 
across several subject areas to show that well over 50 percent of the 
total number of questions asked were memory questions (Stevens, 1912, 
pp. 45-48) . 



There is evidence that pupil communications, too, mirror this pre- 
occupation with facts. Davis and Tinsley (1967) found that factual 
question's dominated 1 teacher question types and that the correlation 
between the cognitive level of questions asked by teachers and those 
asked by pupils was a positive .90. Hudgins and Ahlbrand (1967) re- 
ported that, while 56 percent of teacher' overt verbal behavior was con- 
cerned with factual content, pupil communications in the same classrooms 
emphasized factual matters 81 percent of the time. 



Bloom described factual knowledge acquisition as the most common ed- 
ucational objective in American education (1956, p. 28). As the descrip- 
tive studies cited above illustrate, the classroom discourse of most 
teachers tends to reinforce this goal. There are several possible ex- 
planations. First, teachers may avoid higher-order questions because of 
the difficulty involved. To ask a question that elicits pupil behaviors 
such as seeking relationships or making judgments, the teacher must under- 
stand the processes involved in this type of thinking. Guszak (1966) 
found diminishing congruency between teacher questions and pupil responses 
as grade level increased. He suggested that this might be due to upper 
grade teachers' lacking the answers to their own questions. It was stated 
bluntly by Butler: "When we say that a teacher's questions are poor, we 

actually mean that her knowledge and thinking are. poor (1939, p. 195). 

•«.. , Second, it may be unrewarding for a teacher to ask a question which de- 
mands difficult intellectual operations on the part of the pupil. Rela- 
tionship questions are not easily answered, and teachers may encounter re- 
sistance when these questions are used. This is illustrated in a story 
about John Dewey's visit to a class in which he asked, "What would you. find 
if you dug a hole in the earth?" He received no response so he repeated 
the question, again obtaining only silence. To this the teacher chided, 
"You're asking the wrong question." Then she asked, "What is the state of^ 
the center of the earth?" In chorus, the reply came back, "Igneous fusion 
(cited in Bloom, 1956, , ; p. 29).. Taba (1966) found that the most marked dis- 
crepancies between what teachers "sought and what they elicited from stu 
dents occurred at the highest cognitive levels. One interpretation of this 
finding was that teachers did not "push for the limits" but asked only what 
they knew the students could answer. < 

Another reason that teachers do not use higher-order questions could be 
that they simply do not know how. Only recently has progress been made in 
the: 'analysis of cognitive operations, with development of hierarchical sys- 
tems* of classification such as those of Bloom (1956) and Guilford (1956) 
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in which memory or "knowledge acquisition" is seen as basic and prerequi- 
site to more complex thinking which could be induced by selective ques- 
tioning techniques. It is not surprising, .given the notorious sluggish- 
ness of educational innovation, that this information has not filtered 
into teacher training programs and classroom usage. 

The Importance of Higher-Order Questions 

•higher-order questions presumably engender critical or reflective think- 
ing, which is included as a goal in virtually all statements of educational 
objectives. General treatments of teaching techniques consider the ques- 
tion as a cue to the thinking process (Burton, 1962, Ch. 18; Rivlin, 1961, 

Ch. 7; Butler, 1939, Ch. 10). Dewey's emphasis on transactional exper- 
iences or "learning by doing" stresses problem solving in which the proper 
question sets the stage by introducing a problem. As the first step in 
the reflective thinking process a question can be considered as the verb- 
alized shorthand form of a problem. 

Because of its powerful inquiry-initiating charac teris tics V the higher- 
order question may be a key teaching tool in heuristic teaching styles, 
those constellations of attitudes and techniques by which the teacher 
actively helps students seek knowledge and understanding on their own terms. 

As a questioner the teacher is seen as the guide and stimulator of pupil 
inquiring behavior. Such behavior proceeds as the result of internal self- 
directing processes initiated by a question. It presumably provides prac- 
tice in higher-order thinking. 

The ' assumption that proper questions will elicit higher-level thinking 
has not been empirically demonstrated, although Taba (1966, pp. 119-219) 
maintained that the use of questions which .call for relationship thinking 
encourages pupil higher level responses. Similarly, Hudgins and Ahlbrand 
(1967 , pp. 87-96) reported a significant positive relationship between 
the level of intellectual demand imposed by a teacher and the level of pu- 
pil thinking evidenced by student utterance. 

Most of the studies of teacher-pupil classroom communications have been 
descriptive. The research of Bellack and his associates (1966); Hughes 
(1959); Gallagher (1965a); Aschner (1963); and Flanders and Amidon^(1961) ; 
all sought to classify and code teacher verbal behavior as it occurred in Jfe 
the classroom situation. Other work has attempted to classify teacher- 
pupil interaction in terms of episodes or instructional units which are 
initiated by questions (Meux & Smith, 1964). Few descriptive studies have 
concentrated exclusively on teacher questioning behavior. Dodl (1965) 
classified teacher and pupil patterns of questioning behavior by type of 
responses given before and after a question is asked. 



A few recent studies h 
by some form of training, 
to use a specific set of 



recent studies have attempted to change teacher questioning habits 
orm of training. Taba (1966) compared teachers who had been trained 
specific set of relationship questions with teachers who were 
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untrained and found that the trained group more frequently elicited 
abstract levels of thought from pupils than did the untrained teachers. 
Untrained teachers surpassed trained teachers only in seeking descrip- 
tive or factual information. Another study found that beginning sec- 
ondary intern teachers could be trained to use a larger percentage of 
higher— order questions through the use of videotape or written models 
and micro-teaching sessions (Berliner. McDonald, Allen & Sobol, 1967). 
These studies suggest that higher -order questioning is a trainable skill. 

« A Model for Teacher Training 

»» « \ 

The instructional processes of this study are described by a paradigm 
combining adaptions of two models proposed by Glaser (1962) and McDonald 
(1965). Figure 1 shows the conceptual and operational framework of the 
teacher training program employed. 







The Instructional Process Paradigm 



The instructional process paradigm describes the training procedures 
which/became the input to the 'cybernetic system representing the teacher 
trainee in the training session. 

, ‘v ^ 

Components of an instructional system . Glaser breaks the process of 
instruction into five basic components (Glaser, 1962, pp. 5-30). In- 
itially, there is the setting of goals which will guide and establish 
the instructional procedures. Second, the' student enters the system 
with an initial skill and knowledge repertoire, a particular set of apti- 
tudes, and a prior educational background. Next, instructional procedures 
are employed to, modify or guide the behavior of the student. Fourth, the 
terminal behavior repertoire of the student is evaluated in terms of the 
instructional goals. Over the basic instructional system, Glaser super- 
imposed a research and development component which contributes to each of 
the other sequential segments. The top portion of Figure 1 represents a 
modification of Glaser* s paradigm with the instructional procedures com- 
ponent expanded to focus on the instructional episode as described below. 



The instructional episode . The learning experience occurring in the 
instructional procedures component of Glaser* s model can be described as 
an instructional episode consisting of three components or stages: a 

response-guidance phase, a rresponse-practice phase, and a feedback phase 
(McDonald, 1965, pp. 89-91). In Figure 1 these three phases are labeled 
(1) presentation, (2) practice, and (3) feedback. In the presentation 
phase, the learner receives some form of guidance as to the response o e 
learned. The practice phase entails active attempts on the part of the 
learner to perform the desired response. The feedback phase involves some 
form of information provided to the learner concerning the correctness of 
the response performance. In thi^study practice was held constant while 
presentation and feedback were modified experimentally. 
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There are many ways of implementing the elements of an instructional 
episode. This study chose to focus on modeling as the, mode of presenta- 
tion of the, criterion behavior rather than telling the interns what the 
behavior would be, having them read written descriptions, or;.. having them 
discuss and determine for themselves what the behavior was.’ f The., prac- 
tice phase was implemented • through microteaching sessions in which the 
interns practiced matching the model behaviors they had just seen. The 
feedback phase was implemented through self -view sessions wherein the 
trainees viewed their own performance to r Iee how closely they actually 
matched the model ^behavior. . . , ® 



The Teacher- Pupil Interaction Paradigm 



The teacher-pupil interaction paradigm describes the process* by which 
a teacher, as a cybernetic system, could influence the behavior of a pu- 
pil, as another cybernetic system. This pro.cess paradigm could. .be in- 
definitely extended to include a network of relationships between pu- 
pils as well as between pupils and other agents in an instructional sit- 
uation. It could also describe chains of "teacher- teaching — pupil-being- 
taught" episodes such as those suggested by Smith (1960) . In- this study 
it was used to describe a model ing-i^.,juation process by which teacher . 
trainees could learn to use higher-order questions by matching the be- 
havior of a model teacher. Alt was also used to describe processes by 
which a^pupil learns to ask higher-order questions by matching behaviors 
of a classroom teacher, or gains practice in higher-order thinking through 
external and' internal feedback occurring as a result of answering teacher 
higher-order questions. 



The dual input-output mpdel shown in the lower portipn of Figure 1 is 
based directly on a cybernetic .decision-making model (McDonald, 1965, p. 
60) and' describes the modeling-imitation sequence of the teacher and pupil 
learning. Learning, which corresponds to the "plans" segment of the ^ 
McDonald cybernetic, model, can be seen as an intervening variable (Smith, .. 
1960, p. 236). This interpretation allows for focus on a single teaching 
strategy or skill and a single pupil behavior. ^Conteptually , it can ac- 
count for a stimulus-response (S-R) situation or -for a cognitive restruc- 
turing situation (R-R). * . 



Viewing learning as an intervening variable allows an investigator to 
focus on the overt^ teacher and pupil linguistic behaviors which-are observ- 
able and codable autdi- especially suited to recording media such as the video 
tape recorder and observational rating scales. 
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In this study, teaching was viewed as a repertoire of component behavior- 
al skills which could be learned and practiced separately and then inte- 
grated into a complex teaching strategy by the professional teacher. Com- 
ponent task analysis requires the teacher to focus on a particular skill 



en- 



during the preactive phase of teaching where goals and strategi.es are de- 
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termihed (Jackson, 1966). It logically should then be 
ef to utilize the skill in a deliberate, more effective way during the 
interactive phase of teaching in the classroom. 
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Independent variables in the input of the teacher training segment 
of the paradigm could be of two kinds: internal and external, with the 

internal variables consisting of overt and proprioceptive feedback from 
the pupils,- and the external emanating from outside agents such as texts, 
supervisors, ot performance rating scales. This study focused on the 
external variables or the cues provided by the supervisors in the model 
and feedback sessions of the training x ’sequence. A "cue" is a stimulus 
(auditory, visual, or of some other dimension) which directs attention 
to the salient features of the model immediately prior to the model’s 
response. In this .study the salient features of the model presentation 
were determined by training objectives. 



The Relevance of Observational Learning Theory 



The paradigms of this study approach, the training of a complex teach- 
ing skill from the framework of observational learning theory. In. .terms 
of training a complex skill, modeling appears to be particularly success- 
ful in two types of cases: where novel, responses are involved, and where ’■ 

the desired responses are too weak or** too infrequent to be 'directly re- 
inforced. Many complex human. skills are learned more readily by observa- 
tion and , imitation than by other methods such as successive approximation 
(Hilgard & Bower, 1966, pp. . 534r538) . This is particularly true of novel 
or complex social behavior for which there is no reliable eliciting stim- 
ulus except cues provided by others as theyii* exhibit the behavior (Bandura 
& Walters, 1963). In a series of. experiments with young children from 
1961 to 1966, Bandura and his asso'ciates studied the processes by which \ 
Models transmit behavioral repertoires, change existing response patterns, 
or provide cue responses for later elicitation of specified action strate- 
gies. These studies have showh that the observation of models has* had im- 
portant effects on the behavior of observers. — 

In a 1 study test ingjythe effects of modeling and social reinforcement', 
Bandura and McDonald (1963) found that models were more effective in chang- 
ing-moral -judgment responses than were operant procedures. The study sug- 
gested tflat where. the desired responses were initially weak or occurred in- 
frequently, modeling was more efficient in changing behavior than^the ap- 
plication, of reinforcement. >; The authors pointed out that even though the 
behaviors- tp^ be learned in a training session might already be' in the sub- 
ject’s repertoire, reinforcement procedures alone would not be powerful 
enough to elicit the desired .responses without some procedures for high- 
lighting the salient cues prior v to the elicitation of the ’behavior . 

Several explanations /have been advanced to explain how modeled behaviors 
are learned. Miller and ;Doilard (1941) : provided probably the first inte- 
grated behavior theory for modeling-imitation concepts in their discussion 
of three types of identificatory behavior: "Matched-dependent behavior," 

described as imitation at the subconscious level; "copying behavior*, " in 
which the imitator consciously^ tries to replicate the behavior of a model; 
and "same behavior,"' which .is conscious behavior attributed to mass or 
crowd actions. 
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In their, book, S ocial' Learning arid-limitation , Miller and Dol;||rd 
(1941) -saw .imitative learning as contingent upon reinforcing s'timuli 
administered, either to the model or to the observer as he performs;, a 
close approximation to the matching response. According to Ban ur-a 
and Walters (1963) , stress upon successive approximation places a 
severe limitation Oi' the Miller and- Dollard theory. Imitative behavior 
is often acquired in situations where% model’s responses are not per- ■ 
•formed- -by observers nor is rei-nf orbemen-.t app^d : ..to: models or obs|gers 
during acquisition. Bandura .and Walters suggest that an*o server ^may 
learn new responses from a. model even though he performs no qvept respon- 
ses nor receives direct reinforcement. This applies particularly to the 
learning of novel responses or complex skills. 



Considerable interest in the effects of modeling and the role of 
reinforcement in imitation learning has been generated since 1900. 
Mowrer’s (I960) work on feedbftk led to his distinguishing two types 
of imitative learning. In the; first, reinforcement is applied directly 
to the observer. In the second, ^|he observer receives reinforcement 
vicariously— i.e.-, the model receives reinforcement for appropriate 
responses.' Hill (1960) concurred in the view that an observer empatheti 
cally experiences reinforcement when viewing a model who is reinforced. 



Sheffield (1961). developed a contiguity theory, to account for this 
vicarious acquisition of limitative responses. -The contiguous associa- 
tion of sensory defeats emanating from thefmodel s sequence of behaviors 
enables the observer to acquire "cue responses which_can elici^be . 
ior corresponding to. the model’s behavior some time after demonstration. 
Bandura (1963, 1965a, 1965b) suggested that contiguity, accounts for ^ h • • 
acquisition of model behaviors by the subject, bur that reinforcement^ 
the model rather than of.rthe observer .influences the. performanc e of the 
imitatively learned responses. McB rear ty t , Mars ton and Kanfer U96Z) 
showed that .the’ behavior, of the observer may match the ^ el ! av ^ °{ ed 
model in some cases, even though no direct reinforcement is administered. 



* ^ 

Si's* 



< . *JtA* 

- :* $ 



•A A. 



Most of the previously mentioned studies, have used children or teenagers 
as subjects. Aperies of studies conducted/at Stanford University (McDonald 
& Allen, 1967) were concerned with the training of pre-service intern teach- 
ers in complex teachingS.behaviors . Using the portable^videotape recorder 
as a modeling and feedback device, ^these studies demonstrated that "“dels 
'jffthe desired skills were successtul in changing teaching behavior in the 
training sessions. Orme (1966) reported that perceptual "“deling (i.e., 
with videotapes) was more effective in eliciting; a desired behavio. than 
any" other form of behavior portrayal. Studies by Bandura, “** ed • 

( 1963a 1963b and v 1963c) , demonstrated the effectiveness of. 

Knlf -7 Varenhorst and Ttioresen study (1967) suggested that presentation . 

video *mo dels^in^comseling sessions effectively increases the frequency and; 
variety of information-seeking behavior. .. . 
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T he ..Use of Cueing, in Training; Studies 
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The McDonald and Allen (1967) studies found that those experimental ^ 
groups which experienced supervisor cues during model,, and feedback ses- , ■ • 
sions showed more improvement than those which experienced the self-vi w 
conditions. This was expected on the’ basis of those studies which str^ed 
the importance of discrimination training, prompting, end cues in lea g 
situations XCo_ok & Kendler, 1950; Angell & Lumsdaine, 1961j 
Maccoby , T961 ;”tfulf f & Kraeling, 1$&T). Tt Therefore seemed ' 

to predict in this., study That the supervisor-viewed ( conditions w°tld pro y 
duce greatest changes in (trainee behaviors. Tolman s (19 ) cogni. 

map and Sheffield's (1961). perceptual blueprinting conceptions, sugg^t 

that greater emphasis , should be placed on viewing:«the model 

ine the feedback. Supervisor cues and, prompting during 'the model pre 

mentation. should facilitate the development ofScognitive structures o 
maps which would unify: and guide, future use of the learned skills . 

Thi&; p re diction is in accord 'with Bandura’s (1968) theory th. model- 
ing is an acquisition variable,. Imitative learning o a comp 
behavior involves the' processes of sensory registration and symbolic en- 

of a criterion behavior. 

The Use of Self-View as Feedback 

Recent studies on observation oK, models and self-rewar4 pattera^of 

children have reaffirmed the finding that so|ial rewards dispen^^to 
cnnaren effect on the performance of the observer than if 

there is no consequence for model behavior (Bandura, Grus.ec & Menlove 

' 1967). -The conception of vicariouplreinforcement presents;, the question 

that ner'h'aos use-of videotape recordings in the trainiu^of intern teachers 
■couL P be as elective using reinforced models as with l^e supervisor cues. 
' Addition, the s tudy ]by Gewirtz and Baer ^”8), foundevidence th« : 
the* effectiveness of an adult in reinforcing a child s behavi.pr decreased 
with the familiarity of the adult. Duetto the initial difficulties 
training with videotape recordings, a supportive supervisor is considered 
desirable.. ’The microteachiiffsupervisor in the supervisor-cue situation 

... ££ have' less effect on the behavior of the teacher trainee than the^ 
m0 re distant model in the self-view condition (Bandura, Grusec &.Menlov , 

1967).. 






Ttie Study 



. .The Dependent Variable: Questio ning Behavior 









The dependent variable in this study -was questioning behavior, divided 
into higher order; and lower order, with the primary focg:on the higher-order 

question.* . v" •. ■ , ^ 
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Although there are many views on the structure of a hierarchy of 

< _ ’ *1 1 . J a ^ ^ vmi rt vn r\ f Iri 






questions, the most recent proposals are based on the structure of know- 

' « . -m J ^ 1 1 /DIaaih IQ Ki 



U ^ XVliU ) W**w MAW w — — X r . 

Wedge presented in::, the Taxonomy of. ^Educational Obi ectives , 1 (Bloom, 1956). 
If the Taxonomy~is in fact hierarchical, the higher the cognitive category; 
the more complex the intellectual operations involved in skill used. Since 
the Taxonomy was originally devised as an ordering system for questions . 
asked on the Graduate Record Examinations, it seemed an appropriate guide 
for classifying the questions asked by teachers in their classroom dis- 



course^ 



Questioning behavior was divided into six higher-order and two lower- 
order categories on the basis of the logical distinction occurring be— 

% tween, the broad categories of knowledge and comprehension in the Taxonomy, 
as siiown in Table 1.5 The gross dichotomous distinction is similar to 



oq ui 4 ww -*-*■*■ * w * * o 

McDonald’s (1965) discrimination between factual and relationship ques- 



, vr* 



tiods and tofthe Siegels’ (Siegel 4 Siegel, 1967) distinction between 
factual and conceptual levels^, of achievement. In the' present study, lower- 
order questions corresponde^l^to factual questions associated with the first 
and seventh category labels in the Taxonomy 1 as. revised, employing the oper- 
ations ;6f-t recall or recognition. Higher-order questions corresponded to 
relationship or conceptual questions, which elicited pupil r esp onses , *tha t 
exceeded the rote-memory level of thinking. Higher-order questions .were 
labeled according to the higher level cognition skill categories listed 
in the Taxonomy. The terms "higher” and "lower" were assigned-: on the basis 
of the Taxonomy and imply no value orientation.-? 






The Independent Variables 

:<?$,. 4 

ft Independent variables were the presence or absence of cueing by. super- 
visors during presentations of the Videotape model or viewing of self -per- 
formance in videotape playback sessions (feedback). Supervisors cued train- 
ees on the criterion behavior, higher-order questioning. Four treatment, 
groups involving various combinations of two training mode variables were 
used. The two training modes or techniques were (a) supervisor-view, 
which was the condition in which the intern was.: cued by a supervisor whil 
watching either the videotape model or the playback of his own performanc , 
and (b) ; "alone," which was the condition in whicty;.the intern receiv d 
external cues in model or feedback sessions# 



\ 



/ 



^Sanders (1966) changed the Bloom category of Knowledge to Memory an 
extracted the subcategories of Translation and Interpretation (omitting 
Extrapolation) from’ the Comprehension category of the Taxonomy. 

3 Intercorrelations of the eight categories of questions at each teaching 
session and across all sessions- indicated that the categories, as used in 
this study, were largely independent. The few significant correlations 
£Ed have been due to chance or to the relationship between frequencies of 
questions asked rather than to any systematic relations between the cate 
gories. Additional information on this point may be found in Claus (1968a, 

pp. 47-54). 
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Summary of the Question Classification System and the Characteristics of Questions 
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sets, 



Figure 2 illustrates two interlocking independent-dependent variable 
schematically represented in terms of a modeling-imitation paradigm. 



FIGURE 2 



Interlocking Independent-Dependent Variable Sets in This Study 




The independent variables in the first part of the modeling paradigm 
were combinations of training techniques using a videotape recorded model 
or performance playback with or without supervisor cues. The dependent 
variable used to test the success of the training method was teacher higher- 
order questioning behaviors as exhibited in microteaching sessions. These 
teacher questions then hypothetically became the independent variable for 
pupil learning of questioning skills. Pupil questions were tabulated in the 
same manner as teacher questions. 

The 1 Hypotheses 

The major hypotheses tested in this study were that the frequency of . 
teacher higher-order questioning behavior would be increased more (a) by v 
using cued modeling procedures than by using non-cued modeling procedures, 
and (b) by using cued feedback procedures than by using non-cued feedback 
procedures. In addition, it was suspected that trainees receiving the 
treatment combination in which a supervisor provides discrimination train- 
ing in both model and playback conditions would show a greater gain in in- 
cidence of higher-order questioning than would trainees who received cue- 
ing in only ope viewing condition or who experienced no supervisor cues at 
all. 

Current modeling theory (Bandura, 1968) would support the hypothesis 
that the cued model treatments - might be more effective than cued feedback 
in training the use of a skill which was new to the subjects. 

The Design 

A 2 x 2. fixed effects design was employed to test effects of selected 
combinations of cueing and non-cueing procedures within modeling and self— 
view treatments. Subjects were randomly assigned 'to the four treatment 
groups summarized in Table 2. 

Subjects: The Ss were 4 v 0 pre— service elementary intern teachers 

attending the 1967 summer training session at a California state college 
in the San Francisco Bay Area. 
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TABLE 2 

« 



Summary of the Modeling and Feedback Treatment Groups 



' iW .\‘ 



™- - - 


Treatments 


Group 

Code 


Presentation of 
videotaped model 


Presentation of videotaped 
microteaching sessions 
(self-performance feedback) 


SS 


Trainee viewed videotaped 
model with experimenter 
cueing questioning behavior 
(cued) a 


Trainee viewed videotape of 
self-performance, experimenter 
cueing questioning behavior 
(cued) 


SA 


Viewed with experimenter 


Viewed alone 




(cued) 


(non-cued) 


AS 


Viewed alone 

(non-cued) 


Viewed with experimenter 

*y 

(cued) 

\ 


AA 

# ** 


Viewed alone 


Viewed alone 




(non-cued) 

* 


(non-cued) 



21 ' 

Cued Indicates that the experimenter orally classilied 

questions immediately following the emission of the be- 
haviors on the videotape, e.g. "That was an application 
question." 
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Procedure . Training was conducted in the micro teaching format using a 
modified model-practice-evaluation instructional procedures paradigm 
(Figure 3) . 

FIGURE 3 

Instructional Procedures Paradigm for Microteaching Sessions 



* 



Presentation 



Practice 



Feedback 



Practice 



Videotape 

model' 



Microteaching 
sessions 
(video taped) 



Self-view 
of taped 
micro teaches 



Microteaching 

sessions 

(videotaped) 



(cued or non-cued) 



(cued or non-cued) 



The modeling session consisted of a videotape presentation Vf a 
master teacher displaying the criterion behavior, higher-order question- 
ing. 4 Ss then attempted to match the model behaviors in a practice micro- 
teaching session. The feedback session consisted of the playback of S’s 
own performance on the criterion behavior. All Ss saw the same model 
twice and playbacks of their own performance on their second and third 
trials {.teaching sessions). Each S. taught a total of four ten-minute 
lessons to four different groups of seven sixth-grade pupils. The total 
training sequence consisted of 12 steps summarized in Table 3. Photographs 
of some of the training steps are shown in Figufe 4. 

Rating. Typewritten transcripts of the teaching sessions were ran- 
domly and independently rated by trained raters. Using the eight-category 
classification outlined in Table 1, all questions asked by teachers and 
pupils in a ten-minute lesson period were coded into one of the two lower- 
order or six higher-order categories. A consensus category score was given 
to each question based on over 50 percent agreement between the ratings on 
a question. 

Analysis of variance techniques for determining interrater reliability 
(e.g., Winer, 1962, pp. 124-132) assume the data are in a ratio scale (e.g., 
frequency scores) , that scores are independently drawn from normal treatment 
populations each having the same variance, and that the errors associated 



The model displayed as many desired stimuli as possible during the 
10-minute session. The rationale for this approach. was based upon W. K. 

Estes’ (1959) approach to learning theory which emphasizes the frequency 
of stimuli as the major independent variable in producing learning rather than 
a reward-punishment paradigm. Bandura (1968) has also stressed that a high 
occurrence of observing responses and presence of adequate discriminative 
cues will enable a learner to acquire relatively complicated linguistic 
response patterns through observation. A detailed description of the model 
tape. and the taping procedures may be found in Claus (1968a, pp. 34-37). 
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TABLE 3 

v 

H 

Summary of Steps in Treatment by Experimental Group 



Treatment Step 



Experimental Group Minutes in 

1 2 3 4 Treatment 



1 . 


Set induction^ 5 


X 


X 




X 


60 


2. 


Teach 1 (pretest) 


X 


X 


X 


X 


10 


3. 


Model 1 


A 


A 


s 


s 


10 


4. 


Replan lesson 


X 


X 


X 


X 


15 




Teach 2 


X 


X 


X 


X 


10 


6. 


Self -view of Teach 2 


A 


S 


A 


s 


10 


7. 


Model 2 


A 


A 


s 


s 


10 


8 . 


Replan lesson 


X 


X 


X 


X 


15 


9. 


Teach 3* 


X 


X 


X 


X 


10 


10. 


Self-view of Teach 3 


A 


s 


A 


s 


10 


11. 


Replan lesson 


X 


X 


X 


X 


15 


12. 


Teach 4 (post test) 


X 


X 


X. 


.X 


10 

ft 



a An "X" indicates that the group underwent this treatment without 
experimental modification. An "S" designates the experimental treatment 
wherein a supervisor was present to cue on the desired behavior. An • A 
indicates that the subject was viewing the model or playback tapes alone. 

^Set induction refers to a lecture and discussion period prior ; to 
the main body of the treatment sequence wherein all interns received a "set" 
on the task and information concerning general lesson planning. For .some 
interns there were several 1 days between this set induction period and their 
skill training. 
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with any pair of operations are independent. In determining .the reliability 
of the ratings of several raters on a series of questions, the available data 
consisted of either (1) the codes of the eight different question categories 
for each question by each rater, or (2) the total frequency of questions 
within each category for each rater. In the first instance, the category 
codes were nominal, thus violating the assumption of a ratio scale. In the 
second instance, the sum of the frequencies of all categories for a given 
transcript was fixed for all raters as a consequence of the decision to 
pre-number all questions. Thus the assumption of independent sampling was 
questionable. Another problem was the fact that distributions of scores in 
categories of behaviors which occurred very infrequently would probably 
violate the normality assumption. 

It was decided to use percent ^agreement as a measure of reliability. 
This agreement figure is represented by the ratio: 

Total number of agreements 

Total number of opportunities to agree 

The method of computation is illustrated in Table 4. 

Because transcripts had differing numbers of raters, separate per- 
cent agreement figures were calculated for each number of original raters 
(see Table 5) . These figures ignore the additional ratings which were 
obtained when necessary to derive consensus scores. Table 5 reports the 
percent agreement found for original ratings using the complete eight- 

category system. 

TABLE 4 



Illustration of Computation of Percent Agreement on 
Question Categorizations for Four Questions Rated by Three Raters 



Transcript 
Ques tion 
Number 


A 


Raters 
B C 


Agreement: 

Number of agreements/ 
opportunities to agree 


TQ1 


6 a 


6 


6 


3/3 


TQ2 


3 


2 


2 


2/3 


TQ3 


5 


5 


4 


2/3 


TQ4 


1 


1 


1 


3/3 


* 




Totals 


10/12 






Percent Agreement *83 



a Numbers inside the table are question category code numbers 
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TABLE 5 



Percent Agreement for Ratings of Eight Question 
Categories by Original Sets of Raters 



Number of Original Raters 





2 


3 


4 


8 


Total 


No. of agreements 
No. Opp. to agree 


6276 

•7816 


5500 

6673 


3979 

5007 


106 

144 


15681 

•19640 


Percent agreement 


80.3 


82.4 


, 79.5 


73.6 


80.8 



Results 



The Hypotheses 

The major hypothesis of this study was tha.. the frequency of higher- 
order questioning behavior could be increased more by using cued modeling 
techniques than by using non-cued modeling techniques. A second hypothesis 
was that the frequency of higher— order questioning behavior could be in- 
creased more by cued feedback procedures than by non-cued feedback. It 
was found that cued modeling was significantly (p^.OS) more effective than 
non-cued modeling in producing desired behavior change. The feedback treat 
ments produced no significant effect. 

Comparison of the number of subjects who stayed the same or went down 
in the incidence of the- desired behavior by treatment group suggests a re- 
lationship (Table 6). Group SS, the group with 1 the strongest cueing, ranks 
highest among the groups who increased their use of the skill. Group AA, 
the weakest group in terms of cues received, ranked last in increase of 
the skill. The differences in rankings, however, were not statistically 

significant. 



TABLE 6 



Increase or 
Behavior 

- -.sfy. 


Decrease in 
from Teach 1 


Teacher Higher-Order Questioning 
to Teach 4 by Treatment Group 

• 




- - 


Group 


AA 

(N=10) 


AS 

(N=10)> 


. SA 
(N=10) 


SS 

(N=10) 


* - 


No. increasing 


5 


6" 


6 


8 




No. decreasing or 
remaining same 

r 


5 


4 


-4 


r - 


* 






Treatment Effects on Teachers 



Initial skill level of the subjects . A two-way analysis of variance 
on Teach 1 showed no significant initial differences between treatment 
•groups (Table 7). Therefore, it was assumed that treatment groups started 
with approximately the same level of skill incidence. 



' Analysis of variance on the difference scores (T4 - Tl) of combined 
categories of questions. The major interest of this study was to produce 
a change in questioning behavior from the first teaching session to the 
final teaching session. Therefore, analysis of the difference scores be- 
tween Teach - 4 and Teach 1 on incidence of higher-order questions was the 
first analysis done. 

Two questions were considered before using change scores to test 
treatment effects: (1) Are change scores unreliable? and (2) Why use*' 

change scores in preference to analysis of covariance with Teach 1 scores 

the covariate? • . 
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TABLE ,7. ' " 

«*5 

Summary of Two-Way Analyses of Variance for Modeling, and 
Fee^b-ack Effects on Pretest and on (Posttest-Pretest)' 
Difference Scores of Teacher Higher-Order.: Questioning 



% 



— ■ , ■’ " — “ : ' 


Source of Variation 

* 


SS 


df 


MS 

i 


F 


> ***** 

r , 

Pretest (Tl) 


. 








Modeling Effects (A) 


25.600 


i 


25.600 


0.34 


Feedback Effects (B) 


1.600 


;.r. 1 


1.600 


0.02 


Interaction (A x B) ; 


•r 1.60,0 


1 


1.600 


• 0.02 


Residual (Error) 


2563.200 


'> 36 


71.200 




Posttest- 
Pretest (T4-T1) 










Modeling Effects (A) 


240.250 


i 


240.250 


5.222* 


Feedback Effects (B) 


23.361 


i. * 


23.261 


0.503 

■ «*v 


Interaction (A x B) 


38.028 


i 


38.028 


0.819 



Residual (Error)' 1,486.000 32 46.438 



t*'r 
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The unreliability of change scores has been discussed by Lord (1963), 
vho cites two major sources of confusion in studies of change: errors of 

measurement and regression effects (see also Bereiter , 1963, and We ster 
Bereiter 1963). If two measurements are highly positively, correlated, 
their difference has a smaller variance than iff they w ® r ® £ i ^ e P® n 
la ted This variance, however, is almost all error and it is in this sense 
that; difference . score is unreliable. Also, any.hne change score is.- 

reliable due to regression toward the mean of the group,. , 

t d estivate true change for each subject from individual, observed 

thttgt stotes. However, where effects of separate “-^“^are to^be com- 
pared, estimates of group mean changes can be used. L ( , Lilt-in 

cautions , however, that "analysis of observed' ggins res- “ 
bias in favor of whatever treatments happen to be assigned to ^ nl ? 
low-scoring- groups." Random assignment of individuals to treatments is a 

• prerequisite to control for this bias. ■ - 

The second question concerned the preferability of change score analysis • 
over analysis* of covariance. Analysis of covariance, assumes that the mitral 
score will influence .the amount joj^ ^ improvement . Covariance also assesses treat- 
ments in terms of the "average'^Dilities of the subjects— a significance test 
between the means of the distributions of the adjusted y- scores- If there is 
. n^ifference- in change due to a subject’s initial score, then-change scores . 
caii* be used; just as well as covariance. 5 Difference, scores ' assume^ that the 
amount of. improvement is a constant. 

Analysis of variance performed on difference scores has the .advantage of 
avoiding certain assumptions : made by analysis of covariance. These assumptions 
are: • regressions -are homogeneous; treatment effects and regression effects are 
additive; and residuals are normally; and independently distributed with zero 
means and .equal variances (Winer, 1962, p.;#6). In addition difference scores 
do not present unusual. reliability problems when used to test the significance 
of differences betweeh 'groups rather than to describe individu||: performances . 

t , * - 

a. Higher-order questions. Figure 5 shows that all groups increased or - 
maintained their mean' frequency of ; highef-order questions (HOQ). Two-way analysis 
of variance' on HOQ /(T4 - Tl) -.difference scores showe^that cued model groups in- 
creased their use of higherforder questions significantly more “ 

' non-tued model gfgups - (Table 7) . Cued feedback treatments did not yield signifl 

cant differences. 



At 






^Analysis of covariance on Teach k -using Teach l„as a covariate yielded 
the same result's- as' analysis; of variance on the OA- Tl) difference scores. 

.Modeling, effects were significant at the .05 level;;-,- Feedback effects, were non- 

significant. . 

■ * ( 

" Sue to the viability of some individuals' quhstion-frequency patterns 
across time, natural log transformations of the raw scores were obtained. It was 
hoped that analysis of the differences between the Teach 4 and Teach 1 trans o 
ations would eliminate possible non-homogeneity and 7 yield a* stronger result, ta- 
alvsis of variance on the differences between logs yielded the same results 
fnalysis of variance on the raw difference scores: Modeling effects were sign!- 

ficant (,05< p< .10); feedback and interaction were non-significant. 
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.b. Lower-order questions;.,. As Figure 6 indicates, the non-cued 
model groups showed a decrease in the mean frequency of lower-order ques- 
tions (LOQ) . Cued groups showed an increase. Analysis of variance on (LOQ) 
(T4 - Tl) difference scores showed that cued model groups differed sig- ' 
nificantly from non-cued model groups (p<.01). as seen in Table 8. 

TABLE 8 



. T r» 



Two-Way* Analysis of Variance on 
Teacher Lower-Order 'Questions 



Mean Frequency of Teacher Higher-Order Questions on, Teach 1 and 
Teach 4 for Each Tre^|iment Group. (S indicates cu4d condition; 

A indicates non-cued condition.) 






'<• 



Source of Variation 


SS ' 


df 


MS. 


' ..F 

‘ Si- 


j 

* t 


Modeling Effects (A) 


1092.03 

v - \ 


1 


1092.03 


9.05* 




Feedback Effects .i(B) 


235.23 


1 


235.23 


1.95 




Interaction (A x B) 


50.62 


1 


50. 62' ? 


0.42 




Residual (error) 


, 4339.90 


36 & 


120.60 






*p < ;. 0T ;r ' 
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FIGURE 6 



Mean Frequency of Teacher Lower-Order Questions on Teach 1 
and Teach 4 for Each -Treatment Group. (S indicates cued 
condition; A indicates non-cued condition.) 
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c. Total questions. As expected, "frequency of total questions for cued 
model, groups increased while frequency of total questions decreased for 
non-cued model groups (Figure 7). Analysis of variance on the (T4 - Tl) 
difference scores showed that the inverse relation between the positive 
difference scores of the cued model groups and the negative difference scores 
of the non-cued model groups was significant (p< .005) (Table 9). 



•Stable 9 

Two-Way Analysis of Variance on 
Total Teacher Questions 



Source of Variation 


SS 


df 


MS 


F 


Modeling Effects (A) 


.1918.22 


1 


1918. 22 


9.56* 


Feedback Effects (B) 


308.02 


1 


308.02 


1.54 


Interaction (A x B) 


225.62 


1 


225.62 


1.12 


Residual (error) 


7221.09 


36 


200 . 58 





*p < . 005 



Figure 8 illustrates the relationship between 'the (T4 - Tl) differ- 
ence scores for treatment groups on higher-order questions, lower-order 
questions, and total questions. (Means and standard deviations of [T4 - T1J 
difference scores are found in Appendix A.) Cued model groups showed more in- 
crease in HOQ from Teach 1 to Teach 4 than did non-cued model groups. On 
LOQ, non-cued groups showed negative change from their initial Teach 1 scores, 
cued model groups showed a positive change from their initial scores. Dif- 
ference scores indicate that use of lower-order questions appears to be 
strongly affected by cueing or not cueing a model presentation. Difference 
scores on total questions used between Teach 1 and Teach 4 indicate that 
the combined frequency of question usage also appears to be affected by 
presence or'absence of cueing on the model* 
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FIGURE 7 

Mean Frequency of Teacher Total Questions on Teach 1 
and Teach 4 for Each Treatment Group. (S indicates 
cued condition; A indicates non-cued condition.) 
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TEACHING SESSION 



Figure 9 shows the treatment effects at each teaching session. The 
plot-points for each of the groups were derived from the mean differences 
in frequency of higher-order questions between the second, third, and 
fourth teaching sessions and Teach 1, the pretest. Pretest mean scores 
for each group were plotted at zero (T1 - Tl) to illustrate cumulative 
treatment effects within the two-hour continuous training period (note the 
learning curve of Group SS) , Intervening treatments are indicated along 
the horizontal axis between teaching sessions. Mean frequencies of higher- 
order questions, lower-order questions, and total questions by treatment 
group on all four teaching sessions are shown in Appendix -B. 

Analysis of variance on the proportions of higher-order questions to 
lower-order questions. A Friedman two -wl^ analysis of variance on the 
rank-ordered proportions (Siegel, 1956, pp. 166-173) of higher-order ques- 
tions to lower-order questions over the four teaching sessions yielded sig- 
nificant treatment differences (p< .05) with cued model groups ranking 
higher than non-cued model groups (Appendix C) . 

Analysis of variance on the separate question categories . Analysis 
of variance was performed on the differences between Teach 1 and Teach 4 
frequencies for all eight categories of questions. Analysis questions showed 
a significant increase for cued model groups over non-cued model groups 
(p < . 05) (Table 10). Application questions also increased in frequency from 
Teach 1 to Teach 4 but differences between cued model groups and non-cued 
model groups were only marginally significant (p <. 10) (Table 11). 

Effects on Pupils 

A secondary interest of this study was to determine whether an increase 
in teacher higher— order questioning behavior would influence pupil question- 
ing behavior to change in the direction of greater use of higher-order ques- 
tions. The frequency of pupil questions was- quite low (see Table 12), pre- 
cluding an adequate statistical test of differences. Figure 10 illustrates 
the graphic relation of teacher mean H0Q to pupil group mean H0Q frequency. 
Pupil means and standard deviations by treatment group and teaching session 
are found in Appendix D. 

Correlations of teacher higher-order questions with pupil higher-order 
questions. Correlations of teacher higher-order questions with pupil higher- 
order questions on Teach 1 yielded two negative and two positive coefficients 
(Table 13). None was significant. On Teach 4, however, all teacher-pupil 
correlations were negative. One of these, that for Group AA (r .73), 
was significantly so (p>.05). In addition, the negative correlation of teach 

er total questions with pupil total questions on Teach 4 (r = -.29) ap- 
proached significance (p>.10). 
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TABLE 12 



Number of Pupil Questions in Each Category Oyer All Interns and 

All Teaches 




Questions Category 1 2 
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Questions 302 1 9 87 58 1 2 1 461 



% of Total 

Questions 66 .2 2 19 13 .2 .4 .2 100 



MEAN NUMBER OF HIGHER ORDER QUESTIONS 
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FIGURE 10 

Mean Number of Teacher and Pupil Higher-Order Questions at 
Each Teaching Session by the Treatment Group 
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TABLE 13* 

Correlations of Teacher Higher-Order Questions with Pupil 
Higher-Order Questions on Teach 1 and Teach 4 by Treatment Groups 



Group 


AA 

(N=10) 


AS 

(N=10) 


. SA 
(N=10) 


SS 

•*, (N=10) 


Total 

(N=40) 


Teach 1 


.48 


-.29 


-.38 


.19 


♦ 

-.06 


Teach 4 


-.73** 


-.12 


-..01 


-.43 


-.29* 


*p<.10 

**p< .05 






* ' 







In the AA and SS groups, the correlation of teacher with pupil ques- 
tions changed from positive in Teach 1 to negative in Teach 4. For group 
AA, that change from positive to negative correlation coefficients was sig- 
nificant (p < .01) using Fisher’s jz (Guilford, 1965, pp. 190-191). Tests 
on the differences between the Teach 1 to Teach 4 correlation coefficients 
of the other three treatment groups and on the total Teach 1 to Teach 4 
correlation were not significant. The 'lick of significant findings here ‘ 
could be a function both of the small cell size (n = 10) and of the short 
time (ten minutes) allowed for each training session. 

Summary of Results 

This study investigated the use of cueing procedures in modeling and 
feedback treatments on the acquisition of a teaching behavior. The major 
hypothesis stated that cues from an experimenter on the desired behavior 

modeling and feedback treatments would increase the frequency of the 
teaching behavior being learned. Findings indicated that treatments involv- 
ing modeling with cues were clearly more effective in training teachers to 
use higher-order questions than non— cued modeling treatments. No signifi- 
cant effect was found for the feedback treatments. 
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Frequency data from the study indicated that both teachers and pupils 
used mainly factual questions (Appendix E) . Around 60 percent of the 
questions asked by either teachers or pupils were memory questions. The 
next largest proportion of teacher or pupil questions was accounted for by 
questions calling for the application of knowledge. Analysis questions/ 
were third in frequency. Very little of the teacher-pupil interaction in- 
volved translating, comparing, synthesizing, or evaluating. 

Discussion 



Developing the cognitive potential of children is a centraltaim of 
education. Since- the elementary school years are considered crucial to the 
development of skills of_ reasoning and inquiry, it seems imperative that 
.elementary school teachers should teach in ways r i that encourage development 
>of and provide practice for their ^pupils' intellectual, skills. 

. „ * 

Questioning has been considered/a central teaching tool for eliciting 5 
relationship, or higher-order, thinlcing in children. It is the foundation 
of any type of directed discussion activity (Fenton, 1967) -and the first 
step in problem solution (Dewey, 1933; Suchman, 1962; Taba, 1966). Sev- 
eral studies have indicated that the use o ^questions to;, elicit certain 
types .of thinking is important (Davis & Tinsley, 1967; Davis & Hunkins, 
1966; Pfeiffer & Davis, 1965). It is generally postulated that teachers’ 
actions aret-one of the most important influences on the thought processes 
of children — encouraging freedom to explore alternatives or constricting 
thought to factual specifics. It is important, therefore, that an ef- * 
ficient and effective method be developed to teach teachers how to use 
questioning techniques or at least to sensitize them to the varied range 
of question types available for strategizing learning activities which 
seek to develop the higher cognitive skills. 

...Results of the present study generally confirmed the hypothesis that 
cueing- model presentations would help beginning teachers focus' on speci- 
fic behaviors. to be, learned. Teachers were taught to increase their use 
of higher-order questions by a procedure which involved showing a videotape 
model of a teacher using questioning skills and by providing verbal cues 
on the various types of higher-order questions occurring during the demon- 
stration. Cueing on the .teacher’ s own use of higher-order questions, as 
A displayed in the videotapes of their own practice sessions, did not prove 
to be significantly effective. 

Each- study has limitations in reaching its goals. Thisstudy util- 
ized a relatively small sample of pre-service elementary intern teachers. 
Generali zability of ’the results must therefore be weighed in terms of the 
limitations of low-frequency data and in terms of the typicalness of the 
sample of interns in relation to the general population of pre-service in- 
tern teachers or teachers in general. Certain assumptions as to the chain 
of events from teacher learning to pupil learning were also made. TJiese 
assumptions were stated in terms of ’ the input-output process paradigm 
... guiding the study. 



, A basic assumption was that higher-order questioning is a skill not 
usually possessed by intern teachers. The basic paradigm involved a train- 
ing situation with modeling and feedback conditions interspersed between 
microteaching sessions. In the learning of complex cognitive skills, model- 
ing is an acquisition or learning variable, while feedback is a performance 
variable (Bandura, 1968). This distinction is supported in this study by 
the'_ finding that cued vs. non-cued modeling, produced differential effects, 
while cued vs. non— cued feedback produced no differential effects. Since 
modeling is an acquisition variable and if teachers could not use the ques- 
tioning skill effectively at the start of the graining, then it would be 
reasonable to expect cued modeling to be a more effective learning treat 
ment than non-cued modeling. If feedback primarily governs performance rather 
than learning, it becomes less surprising that during acquisition, cued feed 

back is no more effective than non-cued feedback. 

% 

It is interesting to note that plots of the difference scores at each 
teaching session illustrate learning curves which are in accord wit * P* e " 
dictions of social learning theory as described by Bandura (1965c, 1967, 

1968). (See Figure 9, p. 28.) 



Group SS showed a rapid acquisition of the criterion behavior; and 
then asymptotic performance (which' could be a function of a ceiling effect 
imposed by^ the ten-minute performance session) . According to Bandura s 
1968) suggestion that modeling is an acquisition variable, it is pre- 
dictable that subjects in a cued model condition w»uld gain in incidence 
of a new skill faster than^subjects who received no discriminative cues 
during model presentations. If feedback is a performance variable, it is 
not surprising that cueing the feedback session helped to maintain the 
level of performance for the SS group. 



• Group SA, although gaining sharply on the final teaching session, 
showed a slow and less predictable acquisition curve, even though this^ 
group also received cues from ^supervisor during modeling sessions. Per- 
haps the absence of cueing on the first feedback session allowed more for- 
getting and^the effects of cueing,, the model were slower m becoming vis- 
ible* The process could be described by an all-or-none learning t eory 
(Hilgard* Atkinson, 1967) in which the cumulative effects build up until 
a great sp~art of learning occurs. v 



Group AS appears .to have maintained a level of performance (due to 
cued feedback) after the initial acquisition with only slight increases on 
each teaching Session 4ee Appendix F, -which shows the mean frequency of 
higher-order, lower-order and total questions at each teaching session). 

Group AA, as a type of control group, received no cues in eil ther model. 

,r feedback conditions. Figure 9 shows a steady decrease in the differ 
Bnce scores- for this group. Perhaps this decreasing curve ^di cates extinc- 
tion of behavior which was learned during the set induction period which 
occurred prior to Teach 1.. Symbolic encoding of the visual images may 
have been too, difficult without external assistance. 
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It was not possible to run control groups who received neither 
modeling nor feedback. No conclusions can be drawn from this study, there- 
fore, regarding the absolute effects of modeling or feedback alone. If 
self-view feedback is a performance variable for complex cognitive tasks, 
and if a subject has mastered the task skills, then he may get sufficient 
cues to regulate his performance from non-cued feedback. 

There are several alternative explanations for the finding that 
cueing was effective with modeling but not with feedback procedures. The 
supervisors may have been able to cue more effectively on the model be- 
haviors than on self-view feedback. They were thoroughly familiar with 
the model tape before the training sessions began: they knew the loca- 

tion and category of each question on the model tape. Cues on the interns' 
own performance were necessarily more spontaneous, since the supervisor 
had no opportunity to see the interns' tapes in advance of the feedback 
sessions. 

Another possibility is that cues from the supervisor may have in- 
terfered with the interns' own perceptions of the type of questions which 
were asked. It seems likely there would be a greater emotional response 
to interference occurring on one's own product than on a model's. 

Yet another possibility is the "cosmetic effect" so often observed 
when people see videotape or film playbacks of their own behaviors. In 
this study, the interns may have been preoccupied with their own general 
appearance in the self— view sessions and failed to attend to cues given 
by supervisors. 

Analysis of the teacher-pupil question relationships revealed neg- 
ative correlations between teacher higher-order, questions and pupil higher- 
order,, questions in the final teaching session, some of which were signi- 
ficant and all of which showed the same trend. v*hen teachers use higher- 
orders questions before pupils are ready for thec ; it may be that the fre- 
quency of pupil lower— order questions rises, since it is then incumbent 
upon the pupil to fill in the necessary factual information in order to 
answer the relationship questions. Conversely, perhaps pupils use more 
higher-order questions when teachers use more lower-order questions. This 
finding was not what was expected on the basis of general observational 
learning theory and the paradigm of this study. . Perhaps modeling pro- 
cedures are limited in their effectiveness when small blocks of time are 
involved in the training sequence. 

Modeling by teachers may not be as effective on pupils as modeling 
by peers in a ten-minute segment of classroom interaction. Also, pupils 
asking higher-order questions may be strongly influenced by variables 
other than modeling, e.g*, teacher reinforcement of higher-order questions 
when they occur or the unfamiliarity of the teacher. Even though care was 
taken to select talkative students for the practice sessions, there still 
may have been a hesitancy on the part of the pupils to ask questions of a 
strange teacher. 
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The ten-minute time limitation presents other interesting problems. 
One is the possible depressant effect of a ten-minute session when a 
complex behavior is involved. There may be some plateau level of per- 
formance which is governed by the time period in. which the task is to be 
performed, as suggested by Keller (1958) in his review of research on 
learning of Morse Code. As teacher higher-order questions increased in a 
ten-minute session, it would be natural that pupils would spend less time 
as king questions and more time responding to complex questions. Ten min- 
utes may also hold the number of certain types of behavior to a minimum 
merely because of anticipation of the end of the session. 



A ten— minute session may not allow for a change in question type by 
practice, resulting in a new, coherent teaching style. Such a short time 
period could not offset other variables which would influence a teacher s 
strategy. As pointed out by Taba at the conclusion of her study (1966), 
teachers’ personal capacities for logical thinking; their skill in form- 
ulating relationship questions; their facility in managing the thought pro- 
duced by those questions; and their capacity for rapid and accurate diag- 
nosis of pupil responses in terms of quality and content are all factors 
which directly affect the training results. Cued modeling groups signi- 
ficantly changed in the total number of questions asked in a session. It 
may be possible to model change in frequency of behavior in a .short per- 
iod of time but a longer period of practice may be needed to change the type 
of behavior through modeling and feedback procedures. 

Consistent with other studies of questioning behavior cited earlier, 
this study found that teachers utilize primarily factual questions in 
planned classroom discourse. This is a firm habit, appearing even in a 
training situation where teachers are told to concentrate on using higher- 
order questions. Also, there is great reliance on the "how to do it 
type of question which calls for application of knowledge. The model tape 
exhibited a larger percentage of these two types of behaviors. It could, 
therefore, be that modeling effects on these behaviors were very powerfu- m 
this study. An alternative explanation is that these two types of questions 
are the easiest to ask, hence their higher frequency of occurence. 

I mplications for Teacher Training 

Training and retraining of teachers is a continuing problem. Any find- 
ing is welcome which might suggest another way to accomplish this task more 
effectively and efficiently. Cued modeling procedures are not only useful 
in the one-to-small-group micro teaching context, but also could find appli- 
cation in a training situation where several teachers meet to learn about 
a complex teaching skill. Large lecture and small discussion groups alike 
could'fifid a training situation useful in which a supervisor or consultant 
.. cues on a desired behavior. Feedback could be provided in a variety of forms 
such as videotaping in the individual classrooms, some form of written ev- 
aluation, or group critique of a performance record. This feedback could 
also be a form of cued videotape record for use by the classroom teacher at 

her own leisure. 
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In short, cued modeling procedures could be adapted to a variety 
of forms allowing considerable flexibility in the planning of teacher- 
training sequences. Use of modeling, to be most effective in the train- 
ing of a complex cognitive task, probably should be accompanied by cues 
which point out salient characteristics and help avoid initial skill 
confusion. 

Much research is needed to determine what effects certain teacher 
behaviors have on pupils. If there is an inverse relationship between 
teacher use of certain types of questions and pupil use of the same types 
of questions, then teachers should be aware of this relationship. 



Future Research Possibilities 

This study suggests questions for further investigation. One of 
these concerns the use of a supervisor to do the cueing. Modeling of a 
complex skill was found effective when cued by an experimenter who iden- 
tified the salient characteristics of the desired behavior when it oc- 
curred in a complex interactional setting. Without this help, only the 
most common of behaviors may have teen easily observed. It is important 
in a cued modeling or cued feedback session to have supervisors who can 
discriminate between the various behaviors. To test the effects of var- 
ious types of cueing compared with the effects of a model presentation 
without cueing, it would be necessary to introduce various combinations 
of supervisor cues with various types of model presentation. An example 
would be to show a model illustrating all of the behaviors to be learne 
and to vary the cueing from total cues on all behaviors, to cueing on 
only selected behaviors, to absence of any cueing as a control. 

'* A related question is whether cueing should include affective ele- 
ments. Still another question is whether cueing could be done by a means 
other than a live supervisor. For instance, comments on a video- or 
audiotape might be used to cue relevant behavior. One could test ef fee s 
of reinforcement of the model (vicarious reinforcement for the subject) 
against direct reinforcement of :he subject’s attending responses as he 

views the model. 

Feedback may be more effective if placed at a point in the training 
sequence different from that used in this study. Associated with Cheques- 
tion of sequence of training is the problem of length of training^ time. 
Would feedback become more effective in longer training sequences. 

Other questions relate to model tape characteristics. Is a model 
which displays a high incidence of behaviors more effective than a 
which illustrates each category slowly and methodically. Would models 
teaching regular-sized classes be more effective than models teaching micro- 
classes? Is model effectiveness related to the sex of the model an e 

sex of the subjects? 
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In this study, it was not feasible to gather field data on the 
subjects* performance on the job long after training. This is inform- 
ation which is needed to test transfer and to determine the effective- 
ness of the skill training. A longitudinal study in the field :ould 
also determine if there are cumulative effects on pupils from l le con- 
tinued use by teachers of particular types of questions. What effect 
does a learner’s asking of higher-order questions have on his own learn- 
ing abilities? Pupils may learn just as well without overtly asking 
higher-order questions. McDonald’s (1968) model of mathemagenic behaviors 
suggests that perhaps covert asking of questions by pupils can be one of 
a set of intervening variables operating between teacher verbal discourse 
and pupil overt behavior such as that displayed on an achievement test. 
Heuristic teaching, which may involve modeling of higher-order question- 
ing skills by a teacher, should induce this type of covert behavior on 
the part of pupils which initiates patterns of conceptual thinking. 



Conclusion 

The major question to be answered in this study concerned the effec- 
tiveness of cueing during modeling and feedback presentations. Results 
of the rtudy indicated that cued modeling treatments were clearly more 
effective in training teachers to use higher-order questions than were 
non-cued modeling treatments. Cueing the feedback presentations, how- 
ever, did not appreciably change the use of the criterion behavior. These 
findings lend support to the distinction that modeling is an acquisition 
variable and feedback is a performance variable. 
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APPENDIX A 

Means and Standard Deviations of Difference Scores 
on Teacher Questions £T4 - Ti) By Treatment Group 
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APPENDIX B 

Mean Number of Teacher Higher-Order, Lower-Order and Total 
Questions Asked in Each Teaching Session by Treatment Group 
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APPENDIX C 

Ratios of Frequency of Higher-Order Questions to Frequency of Lower- 
Order Questions in Each Teaching Session by Treatment Group 
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APPENDIX E 

Number of Teacher and Pupil Questions in Each Category 
Over All Interns and All Teaches 
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Mean Number of Teacher Higher-Order Questions 
at Each Teaching Session by Treatment Group 
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Mean Number of Teacher Lower-Order Questions 
at Each Teaching Session by Treatment Group 




ERIC 



TEACHING SESSION 



MEAN NUMBER OF QUESTIONS ASKED 



55 
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Mean Number of Teacher Questions Asked at 
Each Teaching Session by Treatment Group 
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